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AMENDMENTS TO THE CLAIMS 

1 . (original): A system for use in providing data storage and data copies over a computer 
network, comprising: 

a storage server system comprising one or more data storage servers that each comprise a 
data storage device and a network interface, each of said data storage servers operable to 
communicate over said network interface with at least one application client that will require 
data storage and at least one other data storage server; and 

a data management system comprising at least one data management server operable to 

(a) define at least a first and a second cluster each comprising one or more data storage servers, 

(b) define at least one primary voltime of data storage distributed over at least two of said storage 
servers within one of said clusters, said primary volume storing data from the application client, 

(c) define at least one remote volume of data storage distributed over one or more of said storage 
servers within one of said clusters; (d) create snapshots of said primary volume; and (e) copy 
data fi-om said snapshots over the computer network to said remote volume. 

2. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein each of said snapshots provides a view of the 
data stored at said primary volume at the point in time of said snapshot. 

3. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1 , wherein an application client is operable to read data 
stored in said snapshots at said primary volume. 

4. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1 , wherein an application client is operable to read data 
stored in said snapshots at said remote volume. 

5. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein each snapshot includes data that has been 
modified at said primary volume since a previous snapshot of said primary volume. 
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6. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 5, wherein said snapshots are copied to remote snapshots 
associated with said remote volume. 

7. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 5, wherein said snapshots are copied from said primary 
volume to said remote volume and at least a second remote volume distributed over one or more 
of said storage servers within one of said clusters. 

8. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 5, wherein said snapshots are copied from said primary 
volume to said remote volume and at least a second remote volume distributed over one or more 
of said storage servers within one of said clusters, and wherein the source of said snapshots 
copied to said second remote volume is selected based on at least one of the volume most likely 
to be available, the least loaded volume, the volume with the highest bandwidth connection to 
the network, and the volume with a least costly cormection to the network. 

9. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 5, wherein said snapshots are copied from said primary 
volume to said remote volume and are copied from said remote volume to a second remote 
volume distributed over one or more of said storage servers within one of said clusters. 

10. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said snapshots are created according to a 
predetermined schedule defined by said data management system. 

11. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 10, wherein said snapshots are copied to remote 
snapshots associated with said remote volume according to said predetermined schedule. 
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12. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management system is further 
operable to designate said primary volume as a second remote volume that is not able to write 
data from application clients. 

13. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management system is further 
operable to designate said remote volume as a second primary volume, said second primary 
volume storing data from at least one application client independently of said primary volimie. 

14. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 13, wherein said remote volume is designated as said 
second primary volume following a failure of said primary volume. 

15. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 13, wherein said remote volume is designated as said 
second primary volume following a determination by a user to create a second primary volume. 

16. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 13, wherein said data management system is further 
operable to designate said primary volume as a second remote volume that is not able to write 
data from application clients. 

17. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 16. wherein said data management system is operable to 
copy data from a snapshot of said second primary volume to said second remote volume. 

18. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 17, wherein said data management system is operable to 
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generate a snapshot of said primary volume prior to designating said primary volume as said 
second remote volume. 

19. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1 8, wherein said data management system is operable to 

resynchronize said primary volume with said second primary volume. 

20. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said primary volume comprises a plurality of 
logical blocks of data. 

21. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 20, wherein each of said plurality of logical blocks of 
data comprises a plurality of physical blocks of data, each physical block of data comprising a 
unique physical address associated with said data storage device and data to be stored at said 
unique physical address. 

22. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 20, wherein said snapshots comprise pointers to logical 
blocks of data stored at said cluster. 

23. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 20, wherein 

wherein each of said logical blocks of data are copied from said primary volume to said 
remote volume and at least a second remote volume distributed over one or more of said storage 

servers within one of said clusters, and wherein the source of each of said logical blocks of data 
copied to said second remote volume is selected based on at least one of the volume most likely 
to be available, the least loaded volume, the volume with the highest bandwidth connection to 
the network, and the volume with a least costly connection to the network. 
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24. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said network interface is adapted to connect to 
one of an Ethernet network, a fibre channel network, and an infmiband network. 

25. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management system is operable to 
copy data from said snapshots to said remote volume independently of network protocol. 

26. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management system is operable to 
copy data from said snapshots to said remote volume independently of network link bandwidth. 

27. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management system is operable to 
copy data from said snapshots to said remote volume independently of network latency. 

28. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management system is operable to 
copy data from said snapshots to said remote volume at a selected maximum bandwidth. 

29. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 28, wherein said selected maximum bandwidth is 
adaptively set based on the network bandwidth capacity and utilization of the network. 

30. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 28, wherein said selected maximum bandwidth is 
adjusted based on time of day. 



-6- 



Patent Application No. 10/71 1,893 
Reply to Non-Final Office Action dated January 10, 2007 
Reply to Office Action of August 10, 2006 



31. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said first primary volume is located at a first 
cluster and said first remote volume is located at a second cluster. 

32. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 31, wherein said first cluster and said second cluster are 
located at different geographic locations. 

33. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management server is a distributed 
data management server distributed over one or more data storage servers. 

34. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management server is further 
operable to redefine said primary volume to be distributed over one or more data storage servers 
that are different than said at least two data storage servers while copying data from said 
snapshots over the computer network to said remote volvmie. 

35. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 1, wherein said data management server is further 
operable to define at least one replica volume of data storage distributed over one or more of said 
data storage servers within one of said clusters, said replica volume storing data stored at said 
primary volume. 

36. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 35, wherein said data management server is operable to 
create snapshots of said replica volume corresponding to said snapshots of said primary volume, 
and wherein the source of said snapshots copied to said remote volume selected based on at least 
one of the volume most likely to be available, the least loaded volume, the volume with the 
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highest bandwidth connection to the network, and the volume with a least costly connection to 
the network. 

37. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 35, wherein in the event of a failure associated with said 
primary volume, said data management server is operable to copy said snapshots from said 
replica volume to said remote volume. 

38. (original): The system for use in providing data storage and data copies over a 
computer network, as claimed in claim 37, wherein said failure is at least one of a data storage 

server failure and a network failure. 

39. (currently amended): A method for copying data from a primary data storage volume 
to a remote data storage volume in a distributed data storage system, comprising: 

defining a first primary volume of data storage distributed over at least two data storage 
servers within a first cluster of data storage servers , each of said dat a storage servers comprising 
a data storage device and a network interface ; 

generating a first primary snapshot of said first primary volume, said first primary 
snapshot providing a view of data stored at said first primary volume at the time said first 
primary snapshot is generated; 

creating a first remote volume distributed over one or more data storage servers within a 
cluster of data storage servers; 

linking said first remote volume to said first primary volume; and 

copying data from said first primary snapshot to a first remote snapshot associated with 
said first remote volume. 

40. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, further 
comprising: 
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generating a second primary snapshot of said first primary volume, said second primary 
snapshot providing a view of data stored at said first primary volume at the time said second 
primary snapshot is generated; and 

copying data from said second primary snapshot to a second remote snapshot associated 
with said first remote volume. 

41. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, wherein 
said second primary snapshot includes data that has been modified at said first primary volume 
since said step of generating a first primary snapshot. 

42. (original): The method for copying data fi-om a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, further 
comprising: 

copying data from said first snapshot to a second remote volume distributed over one or 
more storage servers within a cluster of data storage servers. 

43. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, further 
comprising: 

copying said first remote snapshot fi-om said first remote volume to a second remote 
volume distributed over one or more storage servers within a cluster of data storage servers. 

44. (original): The method for copying data from a primary data storage volume to a 

remote data storage volume in a distributed data storage system, as claimed in claim 39, wherein 
said steps of generating first and second primary snapshots are performed according to a 
predetermined schedule defined by a data management system. 

45. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, wherein 
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said steps of copying said first and second primary snapshots to said first and second remote 
snapshots are performed according to a predetermined schedule defined by a data management 
system. 

46. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, further 
comprising: 

designating said first remote volume as a second primary volume, said second primary 
volume storing data from at least one application client independently of said first primary 
volume. 

47. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 46, wherein 
said step of designating is performed following a failure of said first primary volume. 

48. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 47, wherein 
said step of designating is performed following a determination by a user to create a second 
primary volume. 

49. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 48, further 
comprising: 

designating said first primary volume as a second remote volvmie that is not able to write 

data from application clients. 

50. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 49, further 
comprising: 

copying data written to said second primary volume to said second remote volimie. 
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51. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 49, wherein 
said step of designating said first primary volume as a second remote volume comprises: 

generating a snapshot of said first primary volume; and 
designating said first primary volume as said second remote volume. 

52. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 49, further 
comprising resynchronizing said second primary volume with said second remote volume. 

53. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 52, wherein 
said step of resynchronizing comprises: 

generating a second primary snapshot of said second primary volume providing a view of 
data stored at said second primary volume at the time said second primary snapshot is generated; 

generating a second remote snapshot of said second remote volume providing a view of 
data stored at said first primary volume at the time said third primary snapshot is generated; 

copying data that has been modified at said second primary volume to said second remote 
volume. 

54. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, wherein 
said step of creating a first remote volume comprises: 

creating a volume at a cluster of data storage servers; 

designating said volume as a remote volume; 

linking said remote volume to said first primary volume; and 

setting a maximum bandwidth at which data may be copied to said remote volume. 
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55. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 54, wherein 
said step of setting is based on network bandwidth capacity and network utilization. 

56. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 54, wherein 
said step of setting comprises: 

scheduling a maximum bandwidth at which data may be copied to said remote volume. 

57. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 56. wherein 
said step of scheduling is based on at least one of time of day and day of the week. 

58. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, wherein 
said data management system is a distributed data management server distributed over one or 
more of said data storage servers. 

59. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, wherein 
said primary volume comprises a plurality of logical blocks of data, and wherein said step of 
generating a first primary snapshot comprises moving a pointer associated with each of said 
plurality of logical blocks of data from said primary volume to said first primary snapshot. 

60. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 39, wherein 
said step of copying comprises: 

copying a first portion of said first primary snapshot to said first remote snapshot; 
recording that said first portion has been copied; and 

copying a second portion of said first primary snapshot to said first remote snapshot. 
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61. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 60, wherein 
said step of copying a second portion is interrupted, and said step of copying a second portion is 

re-started based on said step of recording. 

62. (original): The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 60, wherein 
the amount of data included in said first portion is based on an amoimt of data contained in said 
first primary snapshot. 

63. (original); The method for copying data from a primary data storage volume to a 
remote data storage volume in a distributed data storage system, as claimed in claim 60, wherein 
the amount of data included in said first portion is determined based on an elapsed time period 
since starting said step of copying a first portion. 
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